Mirror system and method for acquiring biometric data

ABSTRACT

A system and method for obtaining biometric imagery such as iris imagery from large capture volumes is disclosed wherein a substantially rotationally symmetric mirror such as a cone or sphere is rotated at a constant velocity about a central axis.

RELATED APPLICATIONS

This application is a continuation of and claims priority to U.S.application Ser. No. 12/658,706, filed Feb. 16, 2010, entitled “MirrorSystem and Method for Acquiring Biometric Data,” which is:

a continuation of and claims priority to PCT Application No.PCT/US2008/074751, filed Aug. 29, 2008, entitled “Mirror System andMethod for Acquiring Biometric Data,” which claims priority to U.S.provisional application 60/969,607, filed Sep. 1, 2007, entitled“Methodology for Acquiring Biometric Data Large Volumes,” which are bothhereby incorporated by reference in their entireties; and

a continuation of and claims priority to PCT Application No.PCT/US2008/074737, filed Aug. 29, 2008, entitled “System And Method forIris Data Acquisition For Biometric Identification,” which claimspriority to U.S. provisional application 60/969,607, filed Sep. 1, 2007,entitled “Methodology for Acquiring Biometric Data Large Volumes,” whichare both hereby incorporated by reference in their entireties.

BACKGROUND

This invention relates to systems and methods for acquiring biometricand other imagery, biometric acquisition, identification, frauddetection, and security systems and methods, particularly biometricsystems and methods which employ iris recognition with a camera having afield of view. More particularly the invention relates to systems andmethods for very quickly acquiring iris imagery within a wide capturevolume.

Iris recognition systems have been in use for some time. The acquisitionof images suitable for iris recognition is inherently a challengingproblem. This is due to many reasons. As an example, the iris itself isrelatively small (approximately 1 cm in diameter) and for manyidentification systems it is desirable to obtain a subject's iris datafrom a great distance in order to avoid constraining the position of thesubject. This results in a small field of view and a small depth offield. Even systems which obtain iris data from a close in subject mustbe adapted to subjects which do not stay absolutely still. Systems mustalso deal with subjects which blink involuntarily or drop or swiveltheir head momentarily to check on the whereabouts of luggage.

There is therefore a need to scan very quickly or else the person willhave moved out of the capture volume or the subject's motion will causea blur. In the current state of the art, attempts to resolve thisproblem comprise using a flat mirror to scan but such attempts have notso far resolved the motion blur problem, especially when the camera iszoomed in. The image motion in terms of pixels/second is very high whichmakes it very difficult to obtain high quality imagery with prior artsystems in these situations.

In biometric applications, one or more image sensors are often used tocollect data for subsequent analysis and biometric matching. Forexample, with the face or iris biometric, a single camera and lens isoften used to collect the biometric data. There is an obvious trade-offbetween the resolution required for biometric analysis and matching, andthe field of view of the lens. For example, as the field of view of thelens increases, the capture volume or coverage in which the biometricdata can be observed increases, but the resolution of the data decreasesproportionally. Multiple cameras and lenses covering a larger volume isan obvious solution, but it requires the expense of additional cameras,optics and processing.

Another approach for increasing the capture volume has been to usecontrollable mirrors that point the camera coverage in differentlocations. Specifically, in U.S. Pat. No. 6,714,665 it is proposed touse a wide field of view camera to determine where to point a mirrorthat was mounted on a pan/tilt/zoom assembly. However approaches thatpoint mirrors in such a fashion have to handle one or more key problems,namely: (i) the time latency involved in moving the camera to alocation, (ii) vibration of the mirror and the resulting settling timeof the mirror as it stops and starts motion, (iii) the complexity of themechanical arrangement, (iv) the reliability, longevity and expense ofthe opto-mechanical components for such a moving assembly.

U.S. Pat. No. 6,320,610, Van Sant et al disclosed acquisition ofbiometric data with a mirror on a pan/tilt platform, or a camera onpan/tilt platform. The problem with that approach is that it is veryexpensive or physically impossible to use such a mechanism to point at 2or 3 places in a scene at a very high rate—for example, 5-50 times asecond. If there is a mechanical mirror or pointing mechanism, thenthere is substantial inertia preventing the rapid stopping and startingof the assembly quickly and furthermore such a system needs a verypowerful actuator/motor to rotate a camera assembly. In addition, thereis substantial settling time for the mirror or camera to stop vibratingas the mirror or pan/tilt assembly stops before imagery is acquired, soessentially it makes it almost physically impossible to scan at suchhigh rates.

SUMMARY

It is an object of the present invention to acquire biometric datawithin large capture volumes with high resolution using fewer cameras,or one camera, and without the problems of prior art systems.

The present invention overcomes the problems of the prior art systemsand improves on them by using a continuous mechanical mechanism to solvethe inertia problem, and translates that into imagery that stops andstares at one location and then instantaneously jumps to stare atanother location.

In one aspect the invention comprises using a rotating curved mirror andtilting which allows the image to appear frozen for a fraction of asecond before moving onto the next tile of the scan which also appearsfrozen.

In another aspect the invention comprises a system for acquiringbiometric imagery in a large capture volume from an unconstrainedsubject comprising a rotationally symmetric mirror, motor means torotate the mirror at a constant rotational velocity about an axis, and asensor configured to acquire biometric imagery reflected off of themirror as it is rotated about the axis.

In some embodiments the rotationally symmetric mirror is comprised ofone or more conical sections.

The system can be configured to obtain a set of still images. In someembodiments the system is configured for iris recognition and comprisesone or more conical sections arranged to rotate at a substantiallyconstant rotational velocity around their common axis.

In another aspect the invention comprises a reflection device comprisinga first surface that reflects light off that surface as if off asubstantially rotationally symmetric surface; a second surface differentfrom the first surface that reflects light off that surface as if off asubstantially rotationally symmetric surface; wherein said first andsaid second surfaces are mounted on the same axis such that rotationalsymmetry of each surface is maintained.

The method aspect of the invention comprises acquiring imagery in alarge capture volume by configuring a sensor to view a scene reflectedoff a non-flat surface; mounting the said surface on a rotating axis;and acquiring imagery of the scene reflected off said surface.

In certain embodiments a set of still images of portions of the sceneare obtained.

BRIEF DESCRIPTION OF THE DRAWINGS

These and other objects, features, and advantages of embodiments arepresented in greater detail in the following description when read inrelation to the drawings, but not limited to these figures, in which:

FIG. 1 schematically illustrates a system according to the inventioncomprising a rotating non-flat, conical shaped mirror, camera and lens,and subject.

FIG. 2 is a second schematic illustration of a system according to theinvention where the camera receives image from a second portion of thesubject.

FIG. 3 illustrates the tiling aspect of the invention.

DETAILED DESCRIPTION

While the invention is capable of many embodiments, only a fewembodiments are illustrated in detail herein.

FIG. 1 illustrates an embodiment of the invention wherein a firstnon-flat mirror section 41 is rotated about axis 42 (motor notillustrated), and a second non-flat mirror section 44 is also rotatedabout axis 42 by the same motor. The lens 11 of the camera 16 receivesan image of the subject 15 reflected off surface 44 to the lens 11.

FIG. 2 illustrates the system of FIG. 1 at a different time instant atwhich an image of the subject 15 is reflected off of surface 41 and adifferent portion of the subject is reflected off mirror surface 41 tothe lens.

FIG. 3 illustrates a set of three tiles 61-63, which are sections of thesubject where the camera imagery points successively.

The following is a general description of a system and method accordingto the invention. An image is acquired using a camera system 10, 11, orany other image recording device. A camera system us used that caneither capture images synchronously at a constant rate, orasynchronously on request by a computer-controlled trigger signal. Thecamera may be operated at a variable acquisition rate depending on theresults of previous processing.

The method is highly effective in many respects. First, if thedisposition of the subject is immediately amenable to successful dataacquisition (e.g. eyes are open and their face is facing the system),then the system will acquire iris imagery very rapidly.

However, of the subject is fidgeting or unable to remain stationary, oris distracted by baggage or children for example, then the acquisitionsystem will still acquire imagery, although it might take a slightlylonger period of time. However, the acquisition time for an amenableuser will not be penalized by the system's capability to acquire data inthe case of a less amenable user. This is crucial when subjectthroughput is considered.

The invention performs temporal multiplexing of the camera and opticssuch that at one time instant the camera sensor acquires data from afirst part of the scene and at another time instant the camera sensoracquires data from a second part of the scene, that may or may notsubstantially overlap the first part of the scene. This process isrepeated for additional parts of the scene, until data is once againacquired from the first part of the scene. This process results in tileswhich do not substantially overlap as illustrated in FIG. 3. Theinvention includes a set of configurations of mirrors, cameras andlenses such that this temporal multiplexing and data acquisitionthroughout a specified capture volume can be performed usingopto-mechanical assemblies that move, but have been designed to onlymove in a fashion such that the mechanics and optics required are highlyreliable, have negligible maintenance requirements, require minimalcalibration, and are low-cost and small in size.

In this configuration, a non-flat mirror is continually rotated at aconstant rotational velocity by a small electrical mirror. The mirror isdesigned to be reflective in the wavelengths required for the biometriccamera acquisition device. The non-flat mirror can, for example, bespherical, conical, or other shapes. In the case of conical shapes, aseries of conical sections can be joined together. For example, FIG. 3shows 3 tiles produced by 3 conical sections joined together on oneaxis.

The camera, lens, or other imager, and motor are fixed. The motor isdesigned to rotate at a constant angular velocity. Constant angularmotion eliminates mechanical vibration due to stop/start motion and themotor is very reliable. As the mirror rotates, the part of the sceneviewed by the lens changes as each different conical mirrored sectioncomes into view of the lens. However, the part of the scene viewed bythe lens when each particular conical mirrored sections is in view ofthe lens does not change even though the mirror is rotating, due to therotationally symmetric nature of each mirror segment. During this timeperiod of the mirrors rotation, high quality imagery of the scene at aparticular location is acquired.

The specific location of the scene that is imaged as the mirror rotatesdepends on the position on the mirror to which the sensor is pointed.

To illustrate further, if the camera is mounted such that it is pointedat a first substantially rotationally symmetric mirror (FIG. 1, 44),then even though the non-flat mirror is rotating, the portion of viewreflected off the mirror remains constant and in this case the imageryis collected from an approximately horizontal direction. As the mirrorassembly rotates to bring a second different substantially rotationallysymmetric mirror into view. (FIG. 2, 41), then a second portion of theview, in this case the lower portion, is reflected off the mirroredsurface and collected.

Additional scan patterns can be implemented by combining two or moremirror/motor assemblies in optical series such that the resultant scanpattern is the combination of each individual scan patterns. Morespecifically, one rotating mirror assembly can be mounted with avertical orientation of the axis of rotation, which provides a scanpattern in the vertical direction. A second rotating mirror assembly canbe mounted with a horizontal orientation of the axis of rotation suchthat the optical path reflects off the first mirror assembly and ontothe second mirror assembly. The second mirror assembly provides a scanpattern in the horizontal direction. The speed of rotation of eachmirror assembly is carefully controlled such that the combination of thevertical and horizontal scan patterns results in a scan pattern thatcovers a complete 2 dimensional area. For example, if there are 3separate mirror surfaces within each of the vertical and horizontalmirror assemblies that cover 3 areas in each of the vertical andhorizontal directions, then the speed of rotation of one of theassemblies is controlled to be ⅓ or a third the speed of rotation of theother assembly to ensure that the combined scan pattern covers acomplete 2 dimensional area. Position sensors, such as optical encodersthat are well known in the art, can be used to both measure rotationalvelocity as well as measure the angular position of each rotating mirrorassembly at any time instant in order to optimize the scan pattern suchthat the scan in one mirror assembly is transitioning from one region tothe next at the same time that the scan is transitioning in the secondmirror assembly.

This approach allows large capture volumes to be scanned over time.However, one significant remaining problem is that the during biometricdata acquisition, the optical path is such that the subject appears tomove in the field of view of the camera—in effect, the camera isvirtually scanning across the scene. Depending on the integration timeof the sensor, this can introduce motion blur in the image data. Thiscan be mitigated by illuminating the subject by stroboscopic lighting,which is a commonly-used technique to stop apparent motion in imagesacquired where either the camera and/or subject is moving. Thestroboscopic illumination can illuminate the subject externally, or canbe directed through the moving mirror assembly using a half-silveredmirror in order to direct the illumination directly at the location ofinterest.

Since the imagery is reflected off a non-flat surface, the imagery isstretched or deformed. The deformation is highly predictable and isgiven by the shape of the rotationally symmetric surface. After theimagery has been digitized, the stretching or distortion can be removedby applying an inverse geometric image warping function. As an example,“Corneal Imaging System: Environment from Eyes,” K. Nishino and S. K.Nayar, International Journal on Computer Vision, October 2006, describemethods of removing distortion off a spherical surface.

In some embodiments two or more conical sections of different pitch(angle) are combined on a single component that spins around an opticalaxis. The more conical sections that are added, then the more parts ofthe scene can be scanned. As the conical sections rotate, when the sceneis viewed reflected off one conical section, then a certain part of thefield of view is observed and appears stationary. When the scene isviewed reflected off a second conical section, then a different part ofthe field of view is observed and also appears stationary. The advantageis that a wide area of a scene can be scanned extremely rapidly incontrast with a moving pan/tilt mirror system which introduces motionblur or has a slow scan time. In some embodiments, moderate stroboscopicillumination may be used to stop the motion of the individual in thescene.

The angle of the non-flat mirror such as a cone is chosen based on thefield of view of the lens and the optical configuration. For example,consider a single cone with a 45 degree pitch.

Imagery is reflected by a full 90 degree angle off the conical surface.If the field of view of the imaging system is 10 degrees, then thesecond conical surface may have a pitch that is 10/2=5 degrees differentfrom the first cone, which is either 40 or 50 degrees depending onwhether the desired second part of the scene to be imaged lies above orbelow the first part of the scene. In practice, the pitch of the secondconical surface will be slightly closer to the pitch of the firstsurface in order to ensure that there is overlap between the regionsbeing imaged.

While the invention has been described and illustrated in detail herein,various other embodiments, alternatives, and modifications should becomeapparent to those skilled in the art without departing from the spiritand scope of the invention. Therefore the claims should not beconsidered limited to the illustrated embodiments.

1. A method for acquiring biometric imagery in a large capture volume,the method comprising: rotating a first rotationally symmetric mirrorabout a first axis; and acquiring, by a sensor, biometric imageryreflected off the first rotationally symmetric mirror as the firstrotationally symmetric mirror is rotated about the first axis.
 2. Themethod of claim 1, wherein rotating the first rotationally symmetricmirror comprises rotating the first rotationally symmetric mirror at asubstantially constant rotational velocity around the first axis.
 3. Themethod of claim 1, wherein acquiring biometric imagery comprisesacquiring biometric imagery in synchronization with the rotation of thefirst rotationally symmetric mirror.
 4. The method of claim 1, whereinacquiring biometric imagery comprises acquiring biometric imagery insynchronization with stroboscopic illumination on a correspondingsubject.
 5. The method of claim 1, wherein acquiring biometric imagerycomprises acquiring portions of a scene that are offset with respect toeach other.
 6. The method of claim 1, further comprising rotating asecond rotationally symmetric mirror about a second axis, the secondaxis substantially perpendicular to the first axis, the firstrotationally symmetric mirror reflecting biometric imagery that isreflected off the second rotationally symmetric mirror.
 7. The method ofclaim 1, further comprising illuminating a corresponding subject withstroboscopic illumination.
 8. The method of claim 1, further comprisingmaintaining the sensor in a fixed position.
 9. A system for acquiringbiometric imagery in a large capture volume, the system comprising: afirst rotationally symmetric mirror; motor means to rotate the firstrotationally symmetric mirror about a first axis; and a sensor toacquire biometric imagery reflected off of the first rotationallysymmetric mirror as the first rotationally symmetric mirror is rotatedabout the first axis.
 10. The system of claim 9, wherein the firstrotationally symmetric mirror rotates at a substantially constantrotational velocity around the first axis.
 11. The system of claim 9,wherein the sensor acquires biometric imagery in synchronization withthe rotation of the first rotationally symmetric mirror.
 12. The systemof claim 9 wherein the sensor acquires biometric imagery insynchronization with stroboscopic illumination on a correspondingsubject.
 13. The system of claim 9, wherein the sensor acquires portionsof a scene that are offset with respect to each other.
 14. The system ofclaim 9, further comprising a second rotationally symmetric mirrorrotating about a second axis, the second axis substantiallyperpendicular to the first axis, the first rotationally symmetric mirrorreflecting biometric imagery that is reflected off the secondrotationally symmetric mirror.
 15. The system of claim 9, furthercomprising stroboscopic illumination for illuminating a correspondingsubject.
 16. The system of claim 9, wherein the sensor is maintained ina fixed position.
 17. A method for acquiring biometric imagery in alarge capture volume, comprising: mounting a non-flat reflective surfaceon a rotating axis such that at least a portion of the surface is notperpendicular to the axis; configuring a sensor to view a scenereflected off the non-flat surface, the sensor comprising at least onelens for removing distortion due to the non-flat reflective surface; andacquiring imagery of the scene when the non-flat reflective surface isrotating about the rotating axis.
 18. A method for acquiring biometricimagery in a large capture volume, comprising: mounting a non-flatreflective surface on a rotating axis such that at least a portion ofthe surface is not perpendicular to the axis; configuring a sensor toview a scene reflected off the non-flat surface, the sensor using asecond reflective surface to remove distortion due to the non-flatreflective surface; and acquiring imagery of the scene when the non-flatreflective surface is rotating about the rotating axis.
 19. A method foracquiring biometric imagery in a large capture volume, comprising:mounting a non-flat reflective surface on a rotating axis such that atleast a portion of the surface is not perpendicular to the axis;configuring a sensor to view a scene reflected off the non-flat surface,the sensor digitally removing distortion due to reflection off thenon-flat reflective surface; and acquiring imagery of the scene when thenon-flat reflective surface is rotating about the rotating axis.